IN THE CLAIMS : 

The following is a complete listing of claims and replaces all prior versions and 
listings of claims in the present application: 

1.-3. (Canceled) 

4. (Currently Amended) The method acco r ding to claim 3, wherein the method 
optimizes a third parameter us e d to transform a measur e d valu e of th e s e nsor into a position and 
orientation of the imag e s e nsing unit on a world coordinat e system using the set first and second 
paramete r s, and furth e r comp r ises: An information processing method for optimizing a third 
parameter used to transform a measured value of a sensor into a position and orientation of an 
image sensing unit on a world coordinate system, wherein the sensor comprises a transmitter and a 
receiver, said method comprising the steps of: 

acquiring the measured value of the sensor when an image of the transmitter of the 
sensor is captured by the image sensing unit to which the receiver of the sensor is attached, wherein 
the transmitter of the sensor is an origin of a sensor coordinate system; 

calculating a first parameter used to transform a measured value of a sensor into a 
position and orientation of an image sensing unit by using the measured value of the sensor; 

superimposing a virtual image of the transmitter on a captured image on the basis of 
the calculated first parameter: 

inputting a user's instruction associated with an adjustment value of the calculated 
first parameter, and updating the virtual image in accordance with the adjustment value; 
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setting a second parameter used to calculate a position and orientation of the 
transmitter on a world coordinate system in accordance with a user's manual instruction; 

acquiring another captured image, obtained by capturing an image of the real space, 
where a plurality of markers whose known world coordinate positions are laid out, using the image 
sensing unit and the measured value of the sensor upon capturing the image; 

detecting positions of the plurality of markers included in the other captured image; 

and 

optimizing the third parameter using the measured value of the sensor, the positions 
of the detected markers, [[and]] the world coordinate positions of the detected marker s, and the 
first and the second parameters . 

5 . (Currently Amended) A p r ogram for making a computer implement an 
information processing method fo r calculating a first paramet e r used to transform a measu r ed value 
of a s e nso r into a position and orientation of an image sensing unit, the sensor comprising a 
t r ansmitte r and a r eceiver, said program comprising: 

code for a step of acquiring the measured value of the sensor when an image of the 
t r ansmitte r , placed in a real space, is captured at or nea r ly at the cente r of a captured image, the 
image being captur e d by the imag e sensing unit to which the r eceive r is attach e d; and 

code fo r a ste p of calculating the first param e te r using the measured value of the 

sensor; 

whe r ein the transmitter of the senso r is also placed at the origin of a s e nso r 
coordinate system 
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A program, stored in a computer readable storage medium, for implementing an 
information processing method for optimizing a third parameter used to transform a measured 
value of a sensor into a position and orientation of an image sensing unit on a world coordinate 
system, wherein the sensor comprises a transmitter and a receiver, the program comprising code 
fon 

acquiring the measured value of the sensor when an image of the transmitter of the 
sensor is captured by the image sensing unit on which the receiver of the sensor is attached, 
wherein the transmitter of the sensor is an origin of a sensor coordinate system; 

calculating a first parameter used to transform a measured value of a sensor into a 
position and orientation of an image sensing unit, by using the measured value of the sensor; 

superimposing a virtual image of the transmitter on a captured image on the basis of 
the calculated first parameter; 

inputting a user's instruction associated with an adjustment value of the calculated 
first parameter, and updating the virtual image in accordance with the adjustment value; 

setting a second parameter used to calculate a position and orientation of the 
transmitter on a world coordinate system in accordance with a user's manual instruction; 

acquiring another captured image, obtained by capturing an image of the real space, 
where a plurality of markers whose known world coordinate positions are laid out using the image 
sensing unit and the measured value of the sensor upon capturing the image; 

detecting positions of the plurality of markers included in the other captured image; 

and 
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optimizing the third parameter using the measured value of the sensor, the positions 
of the detected markers, the world coordinate positions of the detected markers, and the first and 
the second parameters . 

6. (Canceled) 

7. (Currently Amended) An information processing appa r atus for calculating a 
first p arameter used to transform a measur e d value of a sensor into a position and ori e ntation of an 
image unit, the senso r comprising a transmitter and a r e c e iver, said apparatus com p rising: 

an acquisition unit e adapted to acquire the measured value of the sensor when an 
imag e of th e t r ansmitt er , plac e d in a real s p ace, is ca p tured at our nearly at the center of a captured 
image, imag e being captur e d by the imag e sensing unit to which the r eceive r is attach e d; and 

a calculation unit ada p t e d to calculate the first paramete r using the m e asur e d value 

of the senso r , 

wh e r e in the transmitter of the senso r is also placed at the origin of a senso r 
coordinate system 

An information processing apparatus for optimizing a third parameter used to 
transform a measured value of a sensor into a position and orientation of an image sensing unit on 
a world coordinate system, wherein the sensor comprises a transmitter and a receiver, comprising: 

an acquiring unit for acquiring the measured value of the sensor when an image of 
the transmitter of the sensor is captured by the image sensing unit on which the receiver of the 
sensor is attached, wherein the transmitter of the sensor is an origin of a sensor coordinate system; 
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a calculating unit for calculating a first parameter used to transform a measured 
value of a sensor into a position and orientation of an image sensing unit by using the measured 
value of the sensor: 

a superimposing unit for superimposing a virtual image of the transmitter on a 
captured image on the basis of the calculated first parameter: 

an inputting unit for inputting a user's instruction associated with an adjustment 
value of the calculated first parameter, and updating the virtual image in accordance with the 
adjustment value: 

a setting unit for setting a second parameter used to calculate a position and 
orientation of the transmitter on a world coordinate system in accordance with a user's manual 
instruction: 

an acquiring unit for acquiring another captured image, obtained bv capturing an 
image of the real space, where a plurality of markers whose known world coordinate positions are 
laid out, using the image sensing unit and the measured value of the sensor upon capturing the 
image: 

a detecting unit for detecting positions of the plurality of markers included in the 
other captured image: and 

an optimizing unit for optimizing the third parameter using the measured value of 
the sensor, the positions of the detected markers, the world coordinate positions of the detected 
markers, and the first and the second parameters . 

8.-14. (Canceled) 
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